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Abstract 

Background: The use of telemedicine in acute stroke care can facilitate rapid access to treatment, but the work 
required to embed any new technology into routine practice is often hidden, and can be challenging. We aimed to 
collate recommendations and resources to support telestroke implementation. 

Methods: Systematic search of healthcare databases and the Internet to identify descriptions of the implementation of 
telestroke projects; interviews with key stakeholders during the development of one UK telestroke network. Supporting 
documentation from existing projects was analysed to construct a framework of implementation stages and tasks, and a 
toolkit of documents. Interviews and literature were analysed with other data sources using Normalisation Process 
Theory as described in the e-Health Implementation Toolkit. 

Results: 61 telestroke projects were identified and contacted. Twenty projects provided documents, 13 with 
published research detailing four stages of telestroke system development, implementation, use, and evaluation. 
Interviewees identified four main challenges: engaging and maintaining the commitment of a wide range of 
stakeholders across multiple organisations; addressing clinicians perceptions of evidence, workload, and payback- 
managing clinical and technical workability across diverse settings; and monitoring how the system is used and 
reconfigured by users. 

Conclusions: Information to guide telestroke implementation is sparse, but available. By using multiple sources of 
data, sufficient information was collated to construct a web-based toolkit detailing implementation tasks, resources 
and challenges in the development of a telestroke system for assessment and thrombolysis delivery in acute care. 
The toolkit is freely available online. 



Background 

The thrombolytic drug alteplase is the only widely accepted 
medical treatment for acute ischaemic stroke. It has been 
licensed for several years in North America and most 
European countries, for intravenous use within three hours 
of stroke, but this restriction, and the need for immediate 
brain scanning, mean that only a small minority of patients 
receive the treatment. Although this proportion is increas- 
ing, recent estimates range from only 1.4% in UK [1], to 
3.7% in USA [2], and 6.6% in Sweden [3]. 
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As well as urgent neuro-imaging, potential candidates 
for stroke thrombolysis need rapid specialist assessment, 
which may be required at any time of the day or night. 
Telemedicine ("telestroke") has been proposed as a means 
of providing access to such assessment in hospitals where 
stroke physicians or neurologists are not always available 
out of hours [4]. The most common telestroke configur- 
ation is a "hub-and-spoke" model, whereby a central "hub" 
organisation provides remote audio-visual access to a 
stroke specialist for decision support in a number of 
peripheral hospitals. 

The use of telestroke systems is increasing. An American 
Heart Association (AHA) survey in 2009 [5] identified a 
total of 33 organisations providing acute telestroke services 
(USA 22, Canada 3, Europe & UK 7, Asia 1), compared 
with 12 identified by a Canadian survey in 2006 [6]. An 
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AHA update in 2012 identified 97 potential telestroke pro- 
grammes in the USA alone [7]. Systematic reviews of tele- 
stroke systems suggest they can improve time to treatment 
[5,6,8,9], with regional collaborations able to achieve higher 
rates of thrombolysis than local services working in isola- 
tion [10]. Minimum standards for the implementation of 
telemedicine for stroke care have been published [11], but 
it is not known how telestroke systems are operationalising 
this guidance in practice. 

The UK Medical Research Council (MRC) framework 
for complex interventions emphasises the importance of 
evaluating the process of implementation, as well as clin- 
ical and cost effectiveness [12]. This is particularly rele- 
vant to telestroke, given the well-known problems of 
embedding e-health technology initiatives into routine 
services [13]. Evidence on the characteristics of successful 
telemedicine applications relates mainly to their use in 
managing chronic conditions [14,15]. Less is known 
about systems for emergency care. Recent systematic re- 
views have pointed to the need for formative methodolo- 
gies to study telemedicine as a complex and collaborative 
process [16,17]. 

As part of a wider project to improve the delivery of 
thrombolysis in clinical networks, we aimed to develop a 
web-based "toolkit" to support telestroke implemen- 
tation, by systematic collation of available guidance for 
best practice. The guiding framework was Normalisation 
Process Theory (NPT): an evaluation model that asks 
what people do to make a complex intervention work- 
able, and to integrate it into practice [18,19]. NPT has 
been proposed as a suitable framework for evaluating the 
implementation of complex interventions [20-22], and 
has previously been used to study the integration of e- 
health initiatives [13,23-26]. 

Methods 

The study reported here is part of a larger National In- 
stitute for Health Research funded project to support 
telestroke implementation in one UK region. This paper 
reports the results of: 

• systematic review of the literature to identify good 
practice recommendations; 

• collation and analysis of implementation resources 
supporting telestroke; 

• stakeholder interviews in one UK telestroke project 
to identify implementation challenges. 

Systematic review 

The search targeted telestroke feasibility studies, process 
evaluations, project descriptions or case studies; qualitative 
research or surveys of stakeholders; and evaluative or ex- 
perimental research. We used the short form Cochrane 
search for stroke, combined with MESH terms and free 



text words for telemedicine (see Additional file 1). In 
smaller databases the short search string "stroke and tele*" 
was used. The following sources were searched: 

• databases of published studies: The Cochrane 
Library, MEDLINE, EMBASE, CINAHL, AMED, 
Psychlnfo, Web of Knowledge, International 
Bibliography of the Social Sciences (IBSS), Health 
Management Information Consortium (HMIC) from 
inception to April 2011; 

• citation searching: via Web of Knowledge for all 
included studies; 

• Conference proceedings and Internet searching: to 
identify telestroke systems in operation, but not 
reported in publications. 

Two reviewers independently screened records on title 
and abstract, and filtered all full-text papers for inclu- 
sion. The inclusion criteria for papers were: 

• Types of studies: Publically available studies 
(2000-2010), containing descriptive, operational, 
or evaluative data on telestroke systems. 

• Types of participants: People with suspected or acute 
stroke, receiving emergency treatment in a health 
care setting. 

• Types of intervention: Telestroke systems were defined 
as the use of audio-visual real-time communication for 
remote consultation with a decision support provider 
at a site distant from the patient, for diagnosis or 
treatment of acute stroke. 

Data to be extracted included: description of devel- 
opment, use, or evaluation of a telestroke system; stake- 
holders' views on barriers and enablers; reference to 
"implementation resources" (e.g. standards, policies, speci- 
fications, protocols, manuals, memoranda, contracts, deci- 
sion aids, guidelines, algorithms) to support telestroke 
system use in acute stroke care; or researchers comment 
on recommendations for best practice (i.e. in discussion). 
Data extraction and coding were undertaken independ- 
ently by two reviewers, after training and inter-rater reli- 
ability checks. Extracted data were analysed using the 
Normalisation Process Theory framework, detailing the 
challenges impacting on telestroke during four stages of 
system: 1) development, 2) implementation, 3) use, and 
4) evaluation. We chose NPT because it is available as 
a structured analytical framework expressly designed to 
understand the process of embedding technological 
systems in health care, and the complexity of the inter- 
action between individuals, new technologies, and con- 
text [27]. It comprises 16 dimensions in four categories, 
illustrated in simplified form from the NPT toolkit [28] in 
Additional file 2. 
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Collation of implementation resources 

Identified contacts for telestroke projects were emailed 
to ask about the public availability of implementation re- 
sources referred to in publications or on websites. Con- 
tent analysis of documents was undertaken to identify 
the details of discrete implementation tasks. 

Case study of Lancashire and Cumbria telestroke network 

We chose to study implementation of a telestroke sys- 
tem in Lancashire and Cumbria (L&C), a geographically 
diverse area in North West England with long travel 
times between hospital sites and no obvious central hub 
organisation. A "network" model, with a roster of spe- 
cialists from all participating organisations providing 
out-of-hours clinical decision support, was chosen as the 
most suitable telestroke service configuration for the 
area. One organisation was designated lead for govern- 
ance purposes, and implementation was facilitated by a 
Cardiac and Stroke Network (CSN): one of 28 regional 
networks with a remit to support improvement in stroke 
services in the UK (more information on the features of 
the telestroke network are provided in Additional file 3). 
Using this network as a case study facilitated real-time 
access to people with direct experience of managing tel- 
estroke implementation across multiple organisations, 
rather than relying primarily on the perspective of hub 
organisations; or on evaluative data from end-users. 

Nine purposively sampled stakeholders were inter- 
viewed during the year up to July 2011, when the system 
went live. These included executive, project, and infor- 
mation technology managers from the regional Strategic 
Health Authority, the CSN, and lead organisation; and 
doctors and nurses from participating emergency, neur- 
ology, and stroke medicine departments. Semi-structured 
interviews were conducted in the workplace by trained re- 
searchers, audio-taped and transcribed. The study was ap- 
proved by the University of Central Lancashire School of 
Health Ethics Committee. Approval was requested from 
the Ethics Committee for the UK Health Service but was 
not required. 

Transcripts were coded using NPT definitions by two 
trained coders who discussed and agreed final codes. 
Summaries of key challenges raised were fed back to in- 
terviewees (four of whom altered aspects of wording), 
and were then integrated into an overall summary of chal- 
lenges within each component of the NPT framework. 

Results 

The initial search identified 4,567 records, which were 
screened and filtered as shown in Figure 1. 

Internet searching on Google (telestroke or stroke + 
telemedicine) identified 1,290 hits; 218 sites were selected, 
and 61 telestroke projects identified. Their Internet sites 



4,567 records 
identified from 
database search 



1 ,515 records filtered 
on title and abstract 



1 ,459 duplicates + 
1 ,593 records 
removed in screening 



225 full text 
papers filtered 



h 64 added from 
secondary 
references 



1 ,290 records 
removed on title and 
abstract 



5 papers not 
obtainable 



88 papers 
included 



Exclusions (196): 
21 not acute stroke 
30 not telemedicine 
145 not research 



Figure 1 Flowchart of included studies. 



were searched, if available, and principal contacts emailed 
to ask about publically available implementation resources. 

Written information from 20 telestroke projects was 
located: 13 had published descriptive or evaluative re- 
search; and eight projects had resources available on the 
Internet (Table 1). 



Table 1 Type of data available from telemedicine projects 


Country 


Projects 


Process Outcomes Internet 
description, research resources 
evaluation 


USA 


STROKE-DOC 


X 




REACH, Georgia 


X X 




TELEBAT, Maryland 


X X 




Massachusetts 


X 




STARR, Arizona 


X 




SOS, Houston Texas 


X X 




INTEGRIS, Oklahoma 


X 


UK 


East of England 


X 




Northumbria 


X 




Scottish Telestroke 


X 




Avon, Gloucestershire, 
Wilts, 


X 




East Kent 


X 


Europe 


Finnish Network 


X 




STENO, Germany 


X 




TEMPiS, Germany 


X X 




TESS, Germany 


X X 




Barcelona, Spain 


X X 


Canada 


Edmonton 


X 




Ontario 


X X 




British Columbia 


X 




Totals 


8 118 
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In addition to project-related papers, we identified a 
policy statement from the American Heart Association 
[11,28]; and a national survey of US stroke and emer- 
gency physicians' attitudes to telestroke [29]. Of the 
eight telestroke projects described, only one (REACH, 
Georgia) had published a formal process evaluation 
[30,31]: the remainder were descriptive studies or accept- 
ability surveys included with reports of clinical outcomes, 
with little methodological detail Critical appraisal was 
not attempted. 

For each stage of telestroke system 1) development, 
2) use, 3) implementation and 4) evaluation, results 
are presented from the three different data sources 
in order: 

a) research-based recommendations for telestroke 
implementation; 

b) implementation tasks and documentary resources 
from existing telestroke projects; 

c) implementation challenges extracted from case 
study interviews (interview number in brackets). 

System development 

a) Research-based recommendations 

Development of a telestroke system involves a large 
number of stakeholders across organisational and profes- 
sional boundaries. The process can be hampered by lack 
of alignment with organisational strategy and business 
processes. Formal collaboration and good communica- 
tion are needed to negotiate complex inter-organisational 
issues, and there needs to be a sustainable, long-term 
business model for investment of financial and other re- 
sources, and sharing of expenses and rewards across par- 
ticipating organisations [30,31]. 

b) Information from existing projects 

Table 2 describes the kinds of tasks and supporting 
documentary resources used by existing telestroke pro- 
jects during system development, either in publications 
or in Internet resources. 

c) Information from case study interviews 

In the NPT framework, "coherence" refers to the sense- 
making work that people need to do individually and 
collectively about the meaning, use, and utility of a new 
practice. In the case study, this "sense-making work" in- 
volved dealing with the different views of stakeholders 
on the evidence for the safety, likely costs and benefits 
of a telestroke system to facilitate thrombolysis. 

Uncertainty about the evidence made it difficult to 
convince managers and commissioners of the need to 
invest in a telestroke system for the potential benefit of a 
small minority of stroke patients. The development of 
a business case was crucial to an appreciation of the 



Table 2 Tasks and resources needed for system 
development 



Tasks Example documentary resources 



Develop a case for need, and design 


Business case 


a system 


Service and system specifications 




Site readiness assessments 




Eligibility/resource requirements 


Involve key individuals and formalise 


Implementation plans/process 


agreement 


guides 




Administrator role/responsibilities 




Minutes of meetings/action plans 


Formalise financial and organisational 


Letters of co-operation/agreement 


agreements. 


Contracts/accountabilities/liabilities 


Facilitate communication and 


Insight days 


awareness 


Bulletins 




Public awareness posters 



potential long-term value of the system. At the time, 
most published information was based on the hub-and- 
spoke service model, so there was little guidance on 
developing a network telestroke model. Although the 
project Steering Group had a clear vision of the poten- 
tial benefits of a network model: "... nothing is dis- 
banded, there is no second class service, everyone is doing 
thrombolysis, " (6) they were also aware of the need to in- 
volve key individuals to reach agreement about clinical 
protocols, financial and governance arrangements. 

Initially, some clinicians were sceptical about the value 
of telestroke because of multiple competing priorities, 
and the perceived difficulties of coordination across or- 
ganisations and disciplines. Work to develop consensus 
across diverse staff groups and organisations included 
employing a Project Manager and a Communications 
Manager; holding telemedicine insight days and events; 
providing extensive training opportunities; identifying 
and working with opinion leaders, and working with 
individual clinicians to let them experience using the 
system. Differing views persisted, but the gradual de- 
velopment of consensus around the need for local stroke 
teams to be involved in thrombolysis delivery meant 
that any individual reluctance was muted: "...no one 
is daring to say they are not keen. Everyone feels it is 
a "must do", not for debate, can't stop it as an indi- 
vidual" (1). 

Communication between organisations was enabled by 
setting up a Telestroke Executive Group, a Stroke Clin- 
ical Advisory Group, and groups of Operational Managers, 
Continuing Professional Development Leads, Imaging 
Managers, and Information Technology Leads. Regular 
meetings of the stroke clinicians were also organised. As 
well as developing technical and operational specifications, 
reaching financial agreements was a major challenge. This 
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included negotiating the transfer of responsibilities and 
costs between different care sectors, all at a time of rapid 
change in the UK Health Service: "Implementation dates 
were far too optimistic, and the lesson learned is that you 
should get finance written down right from the start Money 
has been the biggest hold up" (3). 

System implementation 

a) Research-based recommendations 

Planners need to assess the compatibility of the tele- 
stroke service with existing technical and clinical sys- 
tems, and agree governance procedures and clinical 
pathways tailored to local circumstance [30-33]. 

b) Information from existing projects 

Table 3 summarises the tasks and documentary re- 
sources identified from other projects to support tele- 
stroke system implementation. 

c) Information from case study interviews 

In the NPT framework, "cognitive participation" refers to 
the shared work that people need to do to build and sus- 
tain a new practice. The main challenge reported during 
implementation was coordinating shared clinical, technical, 
and governance procedures across organisations. 

Extensive work was undertaken to build the new prac- 
tice in each organisation, which involved pathway map- 
ping, analysis of training needs, interdisciplinary peer 
review, and links with existing service improvement ini- 
tiatives. Because of the network structure, all organisa- 
tions did feel involved: "We feel we own the system, we 
are part of it, we want it to work" (6). Each organisation 

Table 3 Tasks and resources for system implementation 



Tasks Example documentary resources 



Develop shared clinical resources 


Pathway analysis 




Process and value stream maps 




Standards/quality criteria for 




system use 




Joint clinical pathway 


Develop governance procedures 


Governance policy 




Risk assessment 




Equality & diversity impact 




assessment 




Privacy impact assessment 




Rotas and job planning 


Develop and test the telestroke 


Walkthrough checklist 


system 


Walkthrough action plan 




System maintenance guide 




Troubleshooting guide 




Operational policy 



had its own key clinicians, who might be neurologists, 
stroke physicians, or emergency department consultants. 
Stroke nurse specialists also played a key role in involv- 
ing other staff in using the system. All participating cli- 
nicians had to agree to use standardised policies and 
recording forms; numerous drafts had to be reviewed 
within each organisation before final validation: "Don't 
underestimate the time it takes to set up shared path- 
ways, the need for standardised paperwork works fine 
in theory, but in reality, each site wants to adapt 
and there is no central system for changing the shared 
paperwork" (2). 

Even though the network used an externally managed 
system where all equipment and support was provided 
by a commercial company, there were difficulties with 
data compatibility between nine organisations using 
three different CT imaging systems. The solution was to 
use an external image hosting site, initially funded by 
the Regional Health Authority. Equipment maintenance 
and troubleshooting guides were prepared. Walkthroughs 
at each site highlighted strengths, weaknesses and gaps in 
the telestroke process: "Walkthroughs have been useful, 
because communication sometimes hasn't been as good as 
you thought it was" (3). 

Agreeing a governance structure to clarify where clin- 
ical responsibility lay at each stage of the patient path- 
way was essential. Clinical workloads had to be adjusted, 
revised consultant job plans agreed, and concerns about 
unequal shares of workload among organisations ad- 
dressed. Despite organisational level agreement, individ- 
ual clinicians and their managers struggled to adapt 
workloads to cover the additional sessions as well as on- 
call responsibilities in their own organisations, and is- 
sues remained unresolved even as the system went live: 
"There are still gaps in the rota, there is still job planning 
to be sorted out, still areas that have not signed up to it 
completely" (8). 

System use 

a) Research-based recommendations 

Potential barriers to telestroke system use in practice 
include: 

• Reluctance because of unfamiliarity; low rates of 
system use; perceptions of treatment delay; 
overconfidence in decisions; conflict with cultural 
norms [34-36] 

• Technical problems are fairly rare, but can include 
problems with sound or image quality; or 
difficulties/delays getting access to equipment or 
network [34,36,37] 

• Lack of staff confidence or capability in neurological 
assessment or CT scan reading, fear of clinical 
complications (e.g. haemorrhage) [32-36] 
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• Lack of local IT staff to support the technical 
system [30,31] 

• Cultural differences and poor communication routes 
between disciplines, and centres [30,31]. 

b) Information from existing projects 

Table 4 categorises the tasks and documentary resources 
referred to by existing projects to provide support for 
telestroke system use. 

c) Information from case study interviews 

In the NPT framework the term "collective action" refers 
to the operational work that people do to enact a new 
practice, involving whether people are able to do what is 
required of them; whether they have trust in each other; 
and the necessary skills and resources. Ensuring this 
operational "workability" required tailoring processes to 
the unique conditions at each site, while developing and 
maintaining staff confidence with the technical and cul- 
tural changes engendered by the new system. 

The siting of telestroke equipment and the need for an 
internet connection imposed restrictions on the site of 
clinical care. Decisions about who would provide care 
depended on the site layout and the availability of skilled 
staff at different times of day: "Where are people going to 
be monitored? and who is going to do it? Accident and 
Emergency (A&E) staff are used to monitoring stroke unit 
staff may not be used to 24 hour continuous monitoring 
It needs a Band 5 (registered nurse). If thrombolysis is 
done in A&E, you are taking a nurse out for an hour. 
The ideal thing is to get the stroke specialist nurse to take 
them through the system" (2). Most centres chose to initi- 
ate thrombolysis in the emergency department followed 



Table 4 Tasks and resources for system use 



Tasks 


Example documentary resources 


Develop clinical, operational, 


Prehospital protocol 


and technical processes 


Screen/exclude checklist 




CT scan protocol 




Thrombolysis pathway 




Nursing care plan 




Teleconsult recording proforma 




Joint decision record/monitoring 




Contingency plan 




Patient information/consent 




Roles, responsibilities and competencies 


Develop staff competency 


Training strategy and needs analysis 


and confidence 


Training priorities, programme 






objectives 




Training resources 




Competency assessments 



by transfer to an acute stroke or critical care unit for 
monitoring. Subsequent care was to be provided by the 
local stroke team, although specialists providing support 
for thrombolysis decisions usually checked on patients' 
progress next day. 

Despite extensive training, staff still needed to gain fa- 
miliarity and confidence with the new system. The need 
to work closely with people from different organisations 
meant establishing and adjusting to new working rela- 
tionships: 7 know how my consultant works, have a 
pretty good idea the patients he will thrombolyse, the 
ones he won% when he will thrombolyse out of licence. I 
don't know whether the other consultants will be a little 
more cautious when they are talking to a hospital they 
don't know with staff they don't know. You know, they're 
not going to know our pathway inside out. They will 
probably speak to different staff every time" (7). There 
was also some concern expressed about whether using the 
system would affect the quality of the clinical encounter, 
perhaps reducing the ability to detect subtle clues or to 
interact meaningfully with the patient and family: "There 
may be issues related to preserving privacy and dignity 
that are less well able to be controlled than in face to face 
consultation" (5). Some clinicians were especially worried 
about using the technology, and trainers commented on 
the difficulty of maintaining people s confidence when they 
might only use the system infrequently. 

Wider cultural issues surrounded changes in working 
patterns and relationships between professional groups, 
such as involving stroke physicians in reading head CT 
scans. However, most staff comments concerned the per- 
ennial issues of time and work pressures, and whether they 
could cope with yet another demand, especially one relying 
on complex technology: "... in the middle of the night when 
you're working with maybe one or two trained staff and 30 
patients if you've not used it for two months and suddenly 
you are trying to remember your password at three o'clock 
in the morning..." (8). 

System evaluation 

a) Research-based recommendations 

Most published studies on telemedicine system perform- 
ance have focused on clinical process measures such as: 
pre-hospital delay; time from admission to initial assess- 
ment, specialist consultation, CT scan, blood test results, 
and initiation of treatment. Other suggestions include 
monitoring system use, impact on decision making, and 
acceptability [34-38]. 

b) Information from existing projects 

Table 5 details the implementation tasks and quality in- 
dicators identified from other published telestroke pro- 
jects, and the kinds of documentary resources used to 
support evaluation. 
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Table 5 Tasks and resources for system evaluation 



Tasks Example documentary resources 



Monitor clinical processes and 


Evaluation data flowchart 


outcomes 


Data collection strategy 




Governance reports 


Monitor system use and impact 


Decision support log 


on decision making 




Monitor fidelity, quality, and 


Patient satisfaction questionnaire 


acceptability 


Staff satisfaction questionnaire 



c) Information from case study interviews 

In the NPT framework, "reflexive monitoring" refers to 
the appraisal work that people do to assess and under- 
stand the ways in which a new set of practices affect 
them and others around them. Not much information 
related to evaluation was collected because interviews 
were mainly conducted during the set-up of the tele- 
stroke system, but respondents did comment about how 
the system was being appraised, used, and reconfigured 
by users. 

Even in the early stages, people commented on the posi- 
tive impact on patient outcome compared with existing 
practice: "I think telemedicine definitely has its place. We've 
had two occasions where (the patient) wouldn't have been 
thrombolysed, and they appear to be having a good out- 
come" (9). A plan for formal monitoring of care processes 
and outcomes had been drawn up, but in the first few 
weeks it was realised that the telestroke system was not 
only being used for acute stroke diagnosis and treatment, 
as intended. Clinicians in the A&E department were also 
using it to seek out-of-hours help for patients with other 
neurological conditions, so that the demands on the spe- 
cialist on call were greater than anticipated. Data collection 
was therefore altered to capture the reasons for telemedi- 
cine consultations; and the workload for on-call specialists. 
This issue was still ongoing when interviews ended. 

The interviews also illustrated how attitudes and clin- 
ical behaviour throughout the stroke service were influ- 
enced by the inevitable comparison between centres, 
prompted by inter-hospital collaboration, interdisciplin- 
ary peer review, and pathway mapping. Staff commented 
on the ability to learn from each other, and gain new 
ideas for improving their own service. Participants also 
mentioned unexpected effects such as raising the profile 
of stroke care that were unlikely to be captured by for- 
mal evaluation: "It's really highlighted stroke within our 
Trust which has been beneficial for the stroke team" 
(7) Others commented on the potential for extended use 
of the system in the future, such as clinic assessment. How- 
ever, there was also an appreciation of the possibility of 
failure of technical innovations: "it would be awful for it to 
fail on the first, second or third attempt because if it was to 



happen then people would just say what a waste of time 
put a sheet over it and we'll put in a corner somewhere. 
That has happened previously in the past with telemedicine 
video things that have not been used... various things that 
have just been quietly shoved into a corner because they 
didn't work or they weren't to standard" (8). 

Discussion 

This study involved a search of the main healthcare da- 
tabases, analysis of documents from existing telestroke 
projects, and a longitudinal case study of one UK team 
developing telestroke. The research literature shows lim- 
ited process evaluation of telestroke, with most of the 
barriers identified relating to issues of technical and clinical 
compatibility, and organisational governance. In contrast, 
findings from the case study tended to highlight the com- 
plex relationships between the technical system, and po- 
tential users in diverse contexts. The networked nature of 
the telestroke case study system emphasised the work 
needed to develop consensus. Factors influencing network 
workability included the importance of users' perceptions 
of evidence, workload, potential, and payback; the amount 
of "human" work involved in enrolling and maintaining the 
commitment of a wide range of stakeholders in diverse or- 
ganisational contexts; and the challenges of managing tech- 
nical and clinical workability across multiple environments. 
The facilitating role of the overarching regional Cardiac 
and Stroke Network was crucial: their actions included 
pathway mapping, analysis of training needs, providing ex- 
tensive training opportunities and individualised support, 
arranging cross-site interdisciplinary peer review and links 
with existing service improvement initiatives, managing 
telestroke walkthroughs, and monitoring adjustment of 
clinical workloads and system use. 

Only one other telestroke project has published a process 
evaluation [30,31]. Our study confirms the importance of 
harmonising technical, business, and governance systems 
across organisations but perhaps places more emphasis on 
the impact of introducing a telestroke system on profes- 
sional work patterns and clinical care processes, and the 
amount of time and attention to detail required for imple- 
mentation work. This is the first process evaluation of a 
network telestroke model, and it may be that developing 
horizontal working relationships across multiple organi- 
sations needs more intensive preparation than in a hub 
and spoke configuration, but it is likely that clinical con- 
cerns about establishing and adjusting to new working 
patterns across professional and organisational bound- 
aries are common to all systems. A recent systematic 
review identified 145 articles relating to the evaluation 
of telestroke [39] compared with our search in 2009 
which yielded 88 research articles, but none of the newer 
articles are process evaluations, so this type of study is 
under-represented. 
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The strengths of our study include combining informa- 
tion from multiple sources (primary, secondary, grey lit- 
erature sources) to make the complex and often hidden 
work of implementation more visible. The limitations of 
this study are the reliance on single case study for primary 
data collection. The timeframe of the case study was pre- 
implementation, but this is also the timeframe least stud- 
ied. We also limited our collation of research literature 
and documents from existing telestroke systems to those 
available in the English language, which means we may 
not have tapped into literature from the strong tradition 
of telemedicine innovation in European countries. Much 
process information came from brief descriptions of sys- 
tem commissioning contained within studies focusing on 
outcome, or unreferenced reports traceable only via the 
Internet, so little of it could be critically appraised. The 
most useful information came from excellent implementa- 
tion support packs from Ontario and Oklahoma, and the 
materials to support telestroke evaluation from British 
Columbia. These provided much of the detail for the tasks 
and resources listed in the tables above. 

Conclusions 

Generic toolkits are available to support the implemen- 
tation of E-Health initiatives [40]. This study affirmed 
the importance of establishing an implementation process 
to facilitate mutual adaptation and problem solving across 
organisational and professional boundaries, and dealing 
with the clinical challenges that occur when adopting a 
new technology [15], focusing on the specific example of 
telestroke. Without published accounts of these formative 
processes it is not easy to learn from others to proactively 
design for successful uptake and sustainability of tele- 
stroke. To help future projects we have constructed a 
Standardised Telestroke Toolkit based on the research re- 
view, populated with the stroke-specific resources made 
available by the Lancashire & Cumbria Telestroke Net- 
work. It can be accessed at www.astute-telestroke.org.uk/ 
[41]. The website also gives detailed information from the 
L&C stakeholder interviews, so that others can see the 
amount of work involved and the kind of challenges that 
occurred, and how they were tackled by the project team. 
As one stakeholder said: "I never thought it would take this 
long - it is a complex piece of work!" (4). 
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